
METHOD FOR ELIMINATION OF SPATIAL ARTIFACTS IN DIGITAL IMAGING 

BACKGROUND OF THE INVENTION 

5 1. Field of the Invention 

This invention relates to methods for eliminating spatial artifacts in digital 
imaging, more particularly to a method for applying an aperiodic, halftone, tiling 
scheme to digital images. 
2. Background of the Invention 

10 Digital images are typically reproduced using a grid of elements, such as 

dots or picture elements (pixels). Due to the periodic nature of these grids, 
spatial artifacts can occur in the resulting image. For example, images such as 
those in digital printing may have an artifact referred to as Moire patterns. 

These patterns are formed when two periodic and nearly identical spatial 

15 frequencies interfere, much like the interference patterns caused by two 

disturbances in a body of water. In some areas the 'ripples' sum together, in 
others they subtract. When these sum and difference artifacts appear in spatial 
frequencies perceptible to the human eye, they are perceived and detract from 
the image quality. In displayed or printed images, these patterns may occur 

20 because of the sampling frequency of the input device beats against the halftone 
frequency of the original image. 

Several different approaches have been used to overcome this problem. 
One approach is to apply a random noise pattern to the pixels of the image to 
break up the interference patterns. The random noise pattern is often generated 

25 using blue noise. One example of such an approach is shown in US Patent No. 

5,557,709, issued September 17, 1996. 
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Other approaches process the colors of a printed image to render one 
color in a non-periodic fashion. This serves to break up the interference 
patterns. An example of such an approach is shown in US Patent No. 5, 
740,334, issued April 14, 1998. 

The use of quasiperiodic tools is also shown by US Patent No. 5,379,1 18, 
issued January 3, 1995. In this approach, the frequencies of the appearance of 
the elements of a picture are manipulated. The pattern is quasiperiodic in this 
application, however, as the pattern does achieve symmetry after a number of 
elements are produced. 

One unique aperiodic but non-random pattern is Ammann tiles, named 
after Robert Ammann, one of the discoverers of these tiles. These tiles and 
other aperiodic tiling schemes have base tiles, or proto-tiles, that are then used 
to build larger tiles that have the same aperiodic properties of the base tiles. 
Aperiodic as used in this disclosure refers to non-periodic but non-random 
patterns, unlike those discussed above. No use of these types of patterns has 
been made in digital imaging applications, even though their aperiodicity would 
be useful in these applications. The applications of non-periodic patterns in the 
above approaches manipulate the sampling and pixel frequencies pixel by pixel 
not on an image basis. Applying aperiodicities at the image level has certain 
advantages. 

Therefore, a method and structure applying aperiodic tiles to digital 
images is needed. 
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SUMMARY OF THE INVENTION 

One aspect of the invention is a method for applying aperiodicity to image 
data to mitigate spatial artifacts. The method comprises the steps of receiving 
image data in a periodic format and converting it to an aperiodic format. 
5 Alternatively, the method comprises the steps of receiving data in an aperiodic 
format and converting it to a periodic format. One example of an aperiodicity 
that can be used for formatting the data is Ammann tiling. 

Another aspect of the invention is a system that has an aperiodic input 
device and an aperiodic output device. The input device produces aperiodic 
10 image data and passes it to the aperiodic output device for rendering. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention and for 
further advantages thereof, reference is now made to the following Detailed 
Description taken in conjunction with the accompanying Drawings in which: 

Figure 1 shows examples of two aperiodic base tiles in accordance with 
the invention. 

Figure 2 shows examples of two aperiodic composite tiles in accordance 
with the invention. 

Figure 3 shows one example of aperiodic tiles applied on an image-wide 
basis, in accordance with the invention. 

Figure 4 shows one embodiment of an aperiodic input device operable to 
produce aperiodic image data, in accordance with the invention. 

Figures 5a and 5b show processes for converting between aperiodically 
formatted data and periodically formatted data in accordance with the invention. 

Figure 6 shows one embodiment of a system capable of managing data in 
either aperiodic or periodic formats. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Moire patterns, as mentioned above, are undesirable image artifacts 
caused by the periodicity of the pixel grids used in most digital imaging 
applications. Attempts have been made to disturb or disrupt the interference 
5 patterns. However, at best this type of artifact is only mitigated but not 
eliminated. 

One object of this invention is to eliminate this type of artifact by applying 
an aperiodicity to the image data. An example of an aperiodicity can be found in 

□ what are referred to as Ammann tiles, as discussed in Ammann, et al. "Aperiodic 
0 

£§ 10 Tiles," Journal of Discrete and Computational Geometry, 8:1 -25 (1 992). 

a— 

5 This article sets out the characteristics of these tiles. An example of one 

5 set of the base tiles is shown in Figure 1 . The dimensions of the A1 tile 10 is 

□ p+q wide, and s+r high. There is an indentation that is q wide and s high, as 
jj measured from the top of the tile. The B1 tile 12 has the dimensions of 2p+q 

□ 15 wide and s+r high. There is an indentation that is p wide and s high, as 

measured from the top of the tile. 

In order to be classified as aperiodic, and therefore as Ammann tiles, 
these dimensions must relate to each other in a specific manner. They must 
meet the requirement of: 

P r \ + S 

20 — = - = . 

q s 2 

These tiles also have the unique characteristic that they can be combined to 
create larger congruent compound or super tiles that meet the same dimension 
requirements. 
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As can been seen in Figure 2, an A2 tile 14, shown by the heavier outline, 
is a composition of one A1 tile 10a and one B1 tile 12a. B2 tile 16, again shown 
by the heavier outline, is a composition of one A1 tile 10a and two B1 tiles, 12a 
and 12b. It should be noted that the ps and qs of the two images are not of the 
5 same actual lengths. They are instead proportions to indicate that the tiles meet 
the above criteria. This type of composition of these tiles can be performed until 
an entire image area is substantially covered by the aperiodic tiles. An example 
of these tiles in a high level super tile is shown in Figure 3. As can be seen by 
q the region 20, which is where the tiles do not cover the entire image area, these 
in io tiles are aperiodic. When assembled correctly they do not result in larger 
y periodic super tiles. 

Other types of aperiodic tile patterns exist. This Ammann tiling scheme is 

□ just one example of these types of non-periodic but non-random tiling schemes. 
Lg Further, several Ammann tiling schemes exist and this is just one example of an 

-SEE 

□ 15 Ammann tiling scheme. 

!_= 

Application of these aperiodic tiles can be done in many ways. For 
purposes of this discussion, several different situations will be used as examples. 
In the first example, the actual output device is aperiodic. For video or still 
images displayed on a device such as an LCD display or other type of display 
20 device, the electrodes on the glass would be patterned as these aperiodic tiles. 
For hard copy devices, such as digital printers, the raster image processor (RIP) 
will handle and render the data aperiodically. Both the displaying and printing of 
images will be referred to here as rendering the image. 
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With an aperiodic output device, the input data could be in either aperiodic 
or periodic format. If the input data were already in a compatible aperiodic 
format, the RIP or the video controller of the output device would just render it. If 
the input aperiodicity were of a different characteristic from the output 
aperiodicity, the data would have to be reformatted into the output aperiodicity. 
This situation is similar to the reformatting of aperiodic input data to periodic 
output data, or the reverse, as discussed in more detail below. 

If the input data were in periodic format, it would need to be sampled into 
aperiodic format. As used in the discussion of this invention, periodic format is 
any format that assumes a periodic grid or Cartesian layout. Similarly, although 
the term normally used to describe reformatting digital data of one format into 
digital data of another format is 're-sampling' the term 'sampling' will be used. 
Sampling as defined here will include both re-sampling of digital data and original 
sampling of analog data. Whether the data is analog or digital does not matter in 
the application of this invention. 

Periodic output formats include such formats as VGA, SVGA, etc., for 
display devices and Postscript™ or other print description languages (PDL) for 
hard copy applications. In addition, the term sampling refers to the processing of 
the data to convert it to either aperiodic or periodic format. 

One method to achieve aperiodic input data is to use an aperiodic input 
device. For example, the array of scanning elements used in a scanner could 
operate in an aperiodic fashion. An example of one such scanning bar is shown 
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in Figure 4. A scanning bar 26 scans an image 24. The resulting assignment of 
the incoming data from the bar is formatted according to an aperiodic scheme. 

As can be seen from the pattern of incoming data, the first line of 
scanning data shows that pixel one has data from the leftmost four elements of 
the input array. The third line of scanning data shows that pixel one only has 
data from the leftmost two elements of the input array. In this manner, the 
elements receive data that is immediately placed into aperiodic format. With the 
ability of a system to convert from aperiodic to periodic as necessary, this 
aperiodic input device could be used with any output device. 

If the output device is compatibly aperiodic as well, the data does not 
have to be converted as in the case of periodic formatted data. However, this 
invention is applicable to periodic input and aperiodic output devices as well. 

To convert periodic formatted data to aperiodic format, for example, a 
processor could use a super-cell approach. In this example, the incoming data 
may have a given resolution, such as 640 pixels by 480 rows. The data could be 
converted into aperiodic format by taking pixels 1 and 2 in row 1 and pixel 1 in 
row 2 and averaging them together to arrive at a digital image value. This value 
would then become the value for the aperiodic imaging element shown by tile 22. 
Again, this is for an aperiodic output device. A more accurate method would be 
to allocate proportional image data from overlapping regions of adjacent 
elements. 

A second situation is where the output device is periodic. That is, the 
output device renders images in a Cartesian or grid of pixels, such as a video 
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display or a typical printer with a given dots per inch. If the data is aperiodic, the 
processor or controller would have to map the aperiodic data onto the periodic 
array by what is defined here as a sampling process. This process may involve 
an interpolation process through which the pixels to be turned on in the periodic 
array are determined by a weighting of the pixels formed into one tile of the 
aperiodic format. 

If the incoming data is periodic in format and must be rendered on a 
periodic array, it may be sampled twice. In a first sampling, the data will be 
sampled from the periodic format into aperiodic format, and then resampled into 
the necessary periodic format for rendering. This last step may use the 
interpolation process described above. 

These conversion processes from aperiodic to periodic and periodic to 
aperiodic are shown in Figures 5a and 5b. In Figure 5a, the incoming data 
received at step 30 is periodic format, as defined above. The data then 
undergoes the sampling process described above at step 32. The now aperiodic 
data is then stored in step 34. 

The converse of this process is shown in Figure 5b. In this example, the 
incoming data at step 40 is aperiodic. The aperiodic data is then processed 
through the sampling referred to above at step 42. The data is then stored as 
periodic in step 44. 

In this invention, it is possible that there will be a loss of resolution, 
depending upon the specific sampling technique used to reformat the data. 
However, it is believed that as bandwidth restrictions ease with higher speed 
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processors, the data can be received at a higher resolution than that to be 
displayed. This will allow the application of the aperiodicity to be transparent to 
the end viewer of the images. 

An example of a structure to handle the formatting conversions is shown 
in Figure 6. The aperiodic processor 52 can receive either periodic data 50 or 
aperiodic data 54 and convert it into the other format. As defined here, 
processor includes the possibility of a lookup table. The lookup table, as an 
example, would have the tile position, type and orientation and allow reference of 
them by their equivalent Cartesian grid position. Alternatively, this information 
could be derived on the fly by an arithmetic processor or central processing unit 
(CPU) relying upon the decomposition information of a base tile from the parent 
or super tile. 

This structure could be viewed as the RIP of a printing system. The RIP 
of the printing system would just have to be reprogrammed with the necessary 
commands to allow handling of aperiodic data. This structure could also be 
viewed as the graphics or video controller of a display apparatus. Alternatively, it 
could be a separate structure that performs these functions. This separate 
structure could even be substituted in the front-end of a display device for the 
analog to digital converter. This would allow display data to be initially sampled 
aperiodically as it enters the display device, such as an analog broadcast signal 
entering a television receiver. 

If the functionality of an aperiodic processor were implemented into part of 
the system CPU, the result would be far more flexible. In a preferred 
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embodiment, for example, there is an aperiodic input device and an aperiodic 
output device. The aperiodicity applied would be Ammann tiling. In this 
instance, if the aperiodic processor were implemented inside of the system 
processor, the system processor would recognize the two input/output devices 
as both being periodic and would just pass the data through without converting it 
from one format to another and then back again. 

In summary, the invention applies aperiodic tiling to image data to avoid 
artifacts in images. One such artifact is Moire. Other artifacts such as rosettes, 
image compression or scaling artifacts, and double-dithering artifacts could be 
mitigated by this invention. 

Thus, although there has been described to this point a particular 
embodiment for a method and structure for applying aperiodic tiling to image 
data, it is not intended that such specific references be considered as limitations 
upon the scope of this invention except in-so-far as set forth in the following 
claims. 
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